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(57) Abstract: 

PROBLEM TO BE SOLVED: To provide a method stably 
detecting a scene change frame from a dynamic image 
sequence consisting lots of frames. 

SOLUTION: Processing to suppress local fluctuation is 
executed for Image data l(x, y, t) for each frame in a 
dynamic image sequence to generate converted Image 
data L(x*, t) respectively as to each frame. Then each 
frame is divided into lots of small blocks, Then a block with 
a high similarity or that of each block is detected from a 
frame just before an object frame to calculate a motion 
vector WJ^^ (i. J) representing a spatial address difference 
bebveen both the blocks. As characteristic changes, a total 
sum of motion vectors for each frame, image continuity of 
small blocks in each frame and image continuity in small 
blocks between frames are respectively calculated. 
Frames whose characteristic changes exceed a threshold 
level are selected to be scene change firames. 
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(x.y.t) ii^mi3\^x-y -1 jvi") > p'^m^iT-^z tlz 
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ra-C^eit*7U-Ari:<0ge«lifRT'- j^L (x",y". 
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mz (A) ~ (C) U^LJt J: •) U*> 7fi:MI4 
@5cX'i*3fe!K»3 3 7j«J6l^®H«-«S6Lrv>*t|r#l4, # 
/h«ia3 l„Uov»TOib§'<S' 03 (A) *J 

(B) {zm-rxoiz. wi^imLfz^-mittcifim 

whBliai4ift§'>J^' h;H4 0«L<l4liJX0fcirao - 



jf6**ae:fD»4/hfc=S:-5„ 
[0 0 4 0] ±l2«JS«lJSiJ J:tfi&§'<5' h/l'O^aj,*. 

"'(i.j)Ui5tt*x^«-*MV"*(i,j). , |5|i:< yJS 
«-S-MV*"(i.j), i:^*>-f tOt-r^o t^'c, 
U-A t iZ)Hfi,^mm<omSti:L"'(x\y-)tmi-. 

P-A t <0t.m(07 l^-A t - 1 U4SJt4#M^ 
Offa«:L'-"(x*.y*)fc*-r'{)Wi:i-*o /cfc'L, 
x' l4x*l6]WT KW-:^-?**) CC1T-I4x' =0-3 1 
9, y' 14 y:^|njOT Kl';^-C* I) C i-C-»4 y ' = 0 - 
2 3 9-C*^o 

[0 0 4 1 ] *S5^®H (-m. - n) ~ ( + m, + n) 

tf'OlSffiiatrD (m, n) fc^-ftLT, iOHimjRD 
(m. n) tlTO (3) ^l^iife 9 ^Stc J: ») ^ffil- 
^o/.r/it, m, nl4C:^:t:-l4- 1 6<m, n<16-C 

$> i o 
(0042] 
[£Sc3] 



(3) 

114 (A) - (C) \zmLfzXr>iz. n».^ I *m 

&X-iJ "y-Ammt^^^lt. 0 5 (A) , (B) iZB 
LfzXdiZ. #/h^«lOS&i'<^' h^l'MV-'d, j)l4 0 
lil.^<0*»o|^i:J:-9«rfflSr^i-o Z.ff> X o it&S^i. ^ 

[0 0 4 4] tits. Zff>Xo^zn^tii^^^i>Wl^^i' 
»4, SISt'-:? I (x,y. t) ■ir<Oii<r>i:m^-'n-Bi^ixfzi> 

(x'.y'.t ) im^''M0i^ivfzi,<OX'$>i>o -^(Otzif). 
m$tWi<r>^W-i>^'P^i^^^^^i' (>'<7-y**»/h? < 

§Sr!Km-t*ISSl41g:V^i!ji'^^' h;vU^r;6o 
(0 0 4 5J ttz. :^^^<k7U-A^aig61 9(4, ± 

(c*cfv>-c7u-Artw#®e^'<kfi«r»aiL, st> 

U i 0#mfi^fbe**K11 S:®x..S7P-ASrv->'^ 
'fk7 A fc-r* <)OT-*^o -W5IJSco}l^^T-l4, !^ 
mirgE-fkSt LT, 7 W- AKilf|^iJ§l:S„, 7P- 

ArtUfSiS^JiiKiss, , 7u-Araiifgs6§jiiKiKs 



[0 0 4 6j ® : 7 u-AHiif^i&Sfis^tJi, 

(4) ^l^tJfe^iaS-e^J ^fi. -r^:*>*,i=H^7 W-A 

MV<"(i,j)^= I MV"''(i. j). I + 

(D: y U'-i^rt lift 16 ASSESS, tii. wm^u-i. 



L. (4) ^*OMV"'(i, j)^f:»i, 
10 0 4 7] 

Syv=IZMV^^'(i.j)xy 

i i 

to 0 4 81 

lMV"'(i.j), I (5) 



TIE (5) ^-C- 



(4) 



h;vi:<0#gi=f<lll«-i^*OMV,,„"'(i.j)* (6) A\z 
[0 0 4 91 



-MV" 



'(i.j)= I MV'"(i, j), -MV'"(i-l, j). I + I MV"'(i, j) 



'(i-lj), I + I MV'-(i,j), -MV'(i+l,j). I + I MV'"( 
i.j), -MV'"(i+lJ), I + I MV">(i, j), -MV"'(i. j-1). I + I MV 
•"(i.j), -MV"'(iJ-l), I + I MV"'(iJ), -MV'-'(i,j+l). H- I 



MV'"(i, j), -MV"'{i. j+l),l 

[0 0 5 0] 
[»51 

•••• (7) 

1 J 

[0 0 5 1 1 z<Dy u-Ap^mi$.wi^mmms, ii^:k-c 

-J'U** Lt&^'^i' Y }l'i:^i6-ttHZ^':S\,^Xyl'-M, 
[0 0 5 21 ® : 7 U-AKSfti6#ili^SS, f:l±> 



(6) 

-i.F51iftEi§2MSS, ^&.T<OX'){zntiiti<, % 
i>f^7 l'-Act'OiS§'<i' h ;WMV(i, j) tcJ:*)^ 

O (8) (9) S:-C-^Hi:-£.o 

[0 0 5 31 

k, = i + (MV'"{i. j). / 1 6) 
kj = j + (MV'"{i, j), / 1 6) 
Cixibk, , k, I±*=f|a7 U-AcD/jN<?|l^(i, j) 

IBO (10) S:»;Se^jaS»c J: »), 7W-AraB«i6S 

[0 0 5 41. 
[ic6l 



(8) 

(9) 



-II {| MV^^^(i,j)x -MV 
i j 

-MV^^'''(ki,k3)y 1} •• 
[0 0 5 51 z.<r>i.n\z\^xi^)t>tzyv-u^smmM^ 

to 0 5 61 'k\Z^ ^^^'^-fk^ U-A^tbSBl 9I±. 7 
l^-AKli(gS!i#fiS„;i*^5c&Hl.TH 1 J: »):*:-C-. 
7U-Artil«ib#ji«|]SS, *«flfr^HfflT H 2 J: 

<iTH3 J: »):^-C*'5B#, K**^7 A Sr -> - >^<k 
7U-A (c<?5*5-g-:*:^gEYk7i^-A t <)V»-3o ) t*l 



(t-1) 



+ MV ^^^(i.j) 



•(10) 

0¥J^»c J:*ttf, *t*7U-AH«:^^**^*?d±«5«tr 
V»7W-A*», :^^|g-fk7l'-A t LT^ms*t4o 

[0 0 5 71 itz. ^m#st«tms5 2 1 II, -kM^Xty 



m^r-9i)mM^7'-if lU.y.t) T-*SC:fc 

ro-C, (IS#»ciji§gi-«,o 7 U- A t coHfftr'- if I (x, 
y.t) rtOi&^'<^' h;V«rMV P"'(x,y) fc^L, 
o, MV P"'Uy)U*JttS x««-«rMV P"'(x,y) 
ydt«-*MVP<"(x,y), t ^-f W fc 4o t 
/c, SimiEH (-m, -n) - ( + m, +.n) '^(Om^ 
««-DP (m, n) fcft-rtL, iW^mKDP (m. 

n) jeiTw (1 1) ^uisdiasicj: ijwai-r^o 
/c/iL, (11) ^tfoL ttsms^ajro y if-y-^x 

[0 0 5 81 

(15:7] 



(t) 



I I^^'(x.v)-I^^'^^(x.y)| 
".'(11) 

, «r-f- it-Tit***, ^itc>ii, :*:^|g'fkv U-A^m 

[0 0 6 1 ] 5t-r, 7U-/.KHfti&#fiS P„l±. 
(1 2) i;itv^»ffiT-#*o ;tfiL. (1 2) ^tf, M 
VP'"(x.y)„J±, (1 3) ^TC-^X-Citio 
[0 0 6 21 
[i!c8l 



fe, #fKfi«-. 'E-07W-Atcov»roii«T'-i' (IE 

P-AStf-f-toMftw^Sfcyp-A (t^x.«f 1 0 71^- 
AgflP) Srl!^<®i)O7W-At-t-*<07i«Av»o :^^7 
u-ASreEurttoLTv^^o-e, :^«7U-A|jr^(?>« 
IS7 u- A*>e>^W7 A>£-JfttB-r* J: •? »i, ;*:^7 

s-MSI-c^'&*-t>r-**o 'tis. HftfE'^SBi atc^Sffl 
$*fCv^4iS-7W-Ari:oiiftT'-^*^'b:*:^7 u- 

xifli+L y+ntL 
DP (m. n) =Z I 

P=x+m q=ytn 

10 0 5 9] ^LT. DP (m, n) 7»*e^^ffiSr^x. * 
m, n ^fili^i' h;VMV P"'(x,y) t-r^o 
[0 0 6 0] >Xi^. mmmty l'-A^mg|5 2 3 I4, -k 

j)U*o-v»T^i)(7)7 U-Ari:w#mi:^fkfi*»m 
L, ? e.UCO#Scl:«ftM!4^-^MSrMx.-57 U-A=Sr 
VfE'ft7V'-A (CitSr^^^'(b7W-A 

^•J (D7 U-AUovvT<0#Scl:^'fb:l:fc LT, 7 V- 
AM@if||86#gS P„, 7l'-ArtBi(ti!)#^iKftS P 

MVP"'(x,y)„= I MVP"'(x,y). 

A t (-fclt**)^.®* (x, y) roS!l#'^5' ^ ^HViV P 
(x,y) g[H*iaft;&*<0®^tCOV^-C(0tij^^ 

MVP,.„'"(i.j)= I MVF"»(i.i). -MVP"*(i-lJ). I + I MVP 
"•(i.j), -MVP<"{i-l.j), I + I MVP'"(i.j), -MVP"*(i+l,j). 
I + I MVP'-'(i, j), -MVP'"(i+l. j), I + I MVP"'(i.j), -MVP 
"'(i.j-1). I + I MVP'"(iJ), -MVP"'(i.j-l), l + IMVP"*(i. 
j), -MVP"'{i. j+1). I + I MVP"'(i,j), -MVP'"(i.j+l),l 
(1 4) 

-etr. 7l--Artlif^i6§^iKSS P, SrTK (1 
5) iS:uij&v>»tBi--&, 

[0 0 6 5] 
[Sc9l 



i j 



xy 



[0 0 6 3] 
+ I MVP"'(x,y), I (13) 

^' h ;v b(oi&nmm»m.muv p„„" 
fed 4) ^tc(jev^^ffii-a„ 

[0 0 6 4] 



(12) 



(.x,y)«r5fe:rT 



SP. =IXMVPj.^|tt) (x,y) .... (1 5) 



1 1 



[0 0 6 6] cr-c»ai$it/c7u-ArtM(«SftiaiK 



«sp, 14, WMitr-i'kzm'^i'^^xnGi^ixh^nx- 

[0 0 6 71 ^fcU, ««lflE<t:7U-Al^mg5 2 3«4, 7 
U-A|BIii«»§gS P„**^^K1STH a 4: t):»cT-. 
A»o, 7 U-AF*jljftt!lia^ft S P, *^^^i3fflTH 
b J: O^-C^-S^, K*=H^7 U- A?S: V- v^ffc7 
A (iw*&#^^^ffc7U-A t <>v-^„ ) t^ajjgL 



;^ « SEH Sr a^i- S <«) V - > ^■fb 7 U - A «r 
[0 0 6 81 iJEtCfcv^Tlj:, i <^aj|iO v - v^-ffc^ 

[0 0 6 9] Wxlf, ^JSO?B.^T-l±. lift^#:7jr-7 I' 
- A H -CSli v» -C -5 ^-t If BScSScibS «r Id i 

fltt^^-r* J: 9tcL, J: U-A^ltiJ* 
tf<cort J:v»o U-A^aK^I^UI^^tBI- 
7P-AF*3liftI&#ii^)tS, i-C-#at1-4i0.S*^L 

v»-ct>*7>»5*»<oi!fmas:ibfi (±i2«fii-ciis„) 

[0 0 7 01 ±i^03lifiOJf^M-C-li, WtT'-i' 

[0 0 7 11 

as^ <0 ^ (Z J: fi If , fg V - > ;^ U It ^ 
S84 /il4-gS<^ 7 U - A r t coilftT'- Ui* L^SfW 

C>7 W- Art coif ©gS-, ■f-<07 U- AUOV^TOfr 

xif-ir<oi5.wnyi^-A^it-^iiff)miz$it^minLr-9 



7 l^-Art <0#gil:^jba*r»ai-r*o -?-L-c, .^# 

tifigE^bfi**Biffi «r a X. a 7 U - A S: y - > ^Mb 7 U - 

Ai:-t4„ ^ff)tz>t>. m\SL7'-- 9 \z^\L^mmtfJfJ:^m 

(y ^'X^^'^fttf) 7i*MHr-:*:jRl4v->^^b7P 
-A-Ci:v>7 U-A7i^v->^jb7 l^- A i:|^jai$it* 

^bi-* J; d '5:7 U-AS:v->3cYb7 W-A i: L-C^^ 
(0 0 7 21 4/^C:(^)milO^ = 5&igUJ:fLlf. 

m(ommzm^. ttffe#tta*±jEL/^ (a) e^jaaT 

«-±iSL;t (b) - (d) .•C^lii$n*7 P-AHli^ 
i&iS, 7U-Artljfg|igJiSEKi5J:!>-7P-Arail 
ftiiiS^iKi: L, K7 l^- Ara®f^iia;)^B)f;gBlfllJ: 
t):^-C-, tJ-o, g7L'-Af*3liltt!jiaS!S*^mSBitt 
J:"3:*:-c. K7P-AKiif«ift§S^JS*«0f^fai 
tti »):^T*2.7 U-ASr->->'SMb7 A t-f^o 
taixlf^^vT-af^Lid t-f-St^iit/ 
75^1* V^-C j^tfO 7 U - A r- lifA # *^'B#^.?!I±S^-C 
*4 0-C7U-AR|li«t6iS^JK<4/J>fc*a*»<=>, K 
7 A14 v->^'fb7 P-A t l4$n^:V»o S^wx * 

y- v7l^Kiv^rv»4^4ic7)7 ^-A-ci±r(07 w — A4"0 

^SS«7i*/hfc^'9, 34'0, 7l^-AKliflfei!liJI^S<> 

/h t ^ ;S t> . CO 7 U- AI±-> - >^'fb7 U-A 1 14 

^:^t^^v^o J: or, c<o^=i&5gic inif, m^'^m^ 
§ < lEfbf s 7 p - A ^lifto^a**:*: ^ < ^ib-r 4 
7P-A4rv->g£<b7l/-A t LT^SU^ai-Ci, 
L t , liift^«:7iVh ^ < ^■ffci- -57V'-Al4v'->fE 
^b7 U-At L-C:B^li}$it*feBI^1B:j®-C-^-&o i /t:, 
ioffiPO^EI6^W->->«^ai5ISUJ:Klf, ^=fl 

(mi v->lEib7P-A^tii:^ffi;fcj:yfv->iEfb 
7 1'- A«^m^B<^iitsoj^,®S:Si?g-r-5 Arjexomr* 

-So 

[1212 1 (A) - (C) 14, *^ 7<OSf$*=fl^%*^'li< 

<0«T- 1 «r ^ L 0 T- $> -5 o 
[113 1 (A) fciO' (B) 14, * > 7<0jt§5i^|^^*f 

2<OJ:9=5rH«S^i6l-*Jit<5iS#'^i' h ;i'WSi5q0-C* 

-So 

[12141 (A) - (C) 14, ii ^ytm'^l^^^h^^m 



ims] (A) isXV' (B) Ji. V7&^EI*:&35^^2E 

ime] (A) - (c) «i«e*s^goissosi?5Ei-c* 

1 1 : mi^XtfU 

1 3 : Hfftiatta 

1 5 :-^^fEafP$tJSB 

1 7 : ;fe^#Sct^UiS^ 

1 9 : :kmmtyi^-^^&U 



2 1 : mm^^WLtkih^ 

2 3 : ^g^g^^kvu-Aitffiffls ' 

I (x,y, t) : y u-A <7)ijfST'-^ 

L(x\y\t) '.n^mi^r-^ 

M V p^*»(i, j) : i^WiS {mmmtyi^-^^mm(otb 

F„: i^->^ityu-M.^^ {±mmty u-M.^ 
^) ' . 

f„: z^->mtyu-A^^ (mm^ityi'-^^ 



imi] 



II 

± 



em 



13 



I (x.y.t) 



IS 



17 



MV'*^ (i.j) 



19 



21 



MV P (i. j) 



23 



r 



NO 



— f 



NO 



MVP (i.j) : i^mm. immmty ty-J^^^moW)^^^ h }U) 



NO 

'no 



im2] 



im3] 



(A) 



(B) 



(0 




(A) 



M V 13.0) 

4 



; :..„.V 


1 




1 1^ 




■ 




33 I If llfc«J 



MV (i.j) 



MV (5,0) 



(B) 



MV'"u.j). MV'*'(J.0). MW^*^lS.t» -.tbiS'^^hA' 

ntLmi>n< m^ons'^:^ hA-tosimB («<!>2) 

[HIS] 



MV<«(i.i) 



(A) 



(B) 





-4- 


-4- 


-4- 
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